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Abstract 

Precise microwave measurements of sample conductivity, dielectric, and mag- 
netic properties are routinely performed with cavity perturbation measure- 
ments. These methods require the accurate determination of quality factor 
and resonant frequency of microwave resonators. Seven different methods 
to determine the resonant frequency and quality factor from complex trans- 
mission coefficient data are discussed and compared to find which is most 
accurate and precise when tested using identical data. We find that the non- 
linear least-squares fit to the phase vs. frequency is the most accurate and 
precise when the signal-to- noise ratio is greater than 65. For noisier data, the 
nonlinear least squares fit to a Lorentzian curve is more accurate and precise. 
The results are general and can be applied to the analysis of many kinds of 
resonant phenomena. 
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I. INTRODUCTION 



Our objective is to accurately and precisely measure the quality factor Q, and resonant 
frequency fo, of a microwave resonator, using complex transmission coefficient data as a 
function of frequency. Accurate Q and fo measurements are needed for high precision cavity 
perturbation measurements of surface impedance, dielectric constant, magnetic permeabil- 
ity, etc. Under realistic experimental conditions, corruption of the data occurs because of 
cross-talk between the transmission lines and between coupling structures, the separation 
between the coupling ports and measurement device, and noise. Although there are many 
methods discussed in the literature for measuring Q and resonant frequency, we are aware 
of no treatment of these different methods which quantitatively compares their accuracy or 
precision under real measurement conditions. In practice, the Q can vary from 10^ to 10'^ in 
superconducting cavity perturbation experiments, so that a Q determination must be robust 
over many orders of magnitude of Q. Also, it must be possible to accurately determine Q 
and fo in the presence of modest amounts of noise. In this paper we will determine the best 
methods of evaluating complex transmission coefficient data, i.e. the most precise, accurate, 
robust in Q, and robust in the presence of noise. 

Many different methods have been introduced to measure the quality factor and resonant 
frequency of microwave cavities over the past fifty years. Smith chart methods have been 
used to determine half power points which can be used in conjunction with the value of the 
resonant frequency to deduce the quality factor of the cavity.lil~i In the decay method for 
determining the quality factor, the fields in the cavity are allowed to build up to equilibrium, 
the input power is turned off, and the exponential decrease in the power leaving the cavity 
is measured and fit to determine the quality factor of the cavity.iffii 

Cavity stabilization methods put the cavity in a feedback loop to stabilize an oscillator 
at the resonant frequency of the cavity.i~lll For one port cavities, refiection measurements 
provide a determination of the half power points and also determine the coupling constant, 
allowing one to calculate the unloaded In more recent years, complex transmission 
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coefficient data vs. frequency is found from vector measurements of transmitted signals 
through the cavity.0~0 Methods which use this type of data to determine Q and fo are the 
subject of this paper. 

We have selected seven different methods for determining fo and Q from complex trans- 
mission coefficient data. We have collected sets of 'typical' data from realistic measurement 
situations to test all of the Q and fo determination methods. We have also created data and 
added noise to it to measure the accuracy of the methods. In this paper we consider only 
random errors and not systematic errors, such as vibrations of the cavity which artificially 
broaden the resonance.i~0 After comparing all of the different methods, we find that the 
nonlinear least squares fit to the phase vs. frequency and the nonlinear least squares fit of 
the magnitude of the transmission coefficient to the Lorentzian curve are the best methods 
for determining the resonant frequency and quality factor. The phase vs. frequency fit is the 
most precise and accurate over many decades of Q values if the signal-to-noise ratio (SNR) 
is high (SNR > 65), however the Lorentzian fit is more robust for noisier data. Some of 
the methods discussed here rely on a circle fit to the complex transmission coefficient data 
as a step to finding fo and Q. We find that by adjusting this fitting we can improve the 
determination of the quality factor and resonant frequency, particularly for noisy data. 

In section II of this paper, the simple lumped element model for a microwave resonator 
is reviewed and developed. A description of our particular experimental setup is then given, 
although the results of this paper apply to any transmission resonator. We then discuss 
the data collected and generated for use in the method comparison in section III. Section 
IV outlines all of the methods that are studied in this paper. It should be noted that each 
method is tested using exactly the same data. The results of the comparison are presented 
and discussed in section V. Possible improvements for some of the methods follow in section 
VI, and the concluding remarks of the paper are made in the final section. 
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II. LUMPED ELEMENT MODEL OF A RESONATOR 



To set the stage for our discussion of the different methods of determining 
Q and resonant frequency, we briefly review the simple lumped-element model of an 
electromagnetic resonator. As a model for an ideal resonator, we use the series RLC circuit 
(see inset of Fig. |I]), defining 1/2tx\/ LC as the resonant frequency /o-^ The quality factor 
is defined as 2tt times the ratio of the total energy stored in the resonator to the energy 
dissipated per cycle.0 For the lumped element model in Fig. |T], the quality factor Q is 
2TTfoL/R. The resonator is coupled to transmission lines of impedance Zo by the mutual 
inductances Imi and lm2- The complex transmission coefficient, 5*21 (ratio of the voltage 
transmitted to the incident voltage), as a function of driving frequency /, is given in the 
limit of weak coupling byS 

^21 (/) = ^ f . (1) 

The additional assumption that f ~ fo near resonance simplifies the frequency dependence 
in the denominator resulting in: 

where 5*21 is the maximum of the transmission coefficient which occurs at the peak of the 
resonance: 

2 ^2; 



-^^ 8vr/^U/^2 ^^y^ (3) 

Here R is the resistance in the circuit model and this expression again is valid in the weak 
coupling limit. On the far right side of Eq. (^), /?i and /?2 are the coupling coefficients on 
ports 1 and 2, respectively,!'^ where Pj = (27r/)^ I'^j/ZqE, with j = 1, 2. The magnitude of 
the complex transmission coefficient is: 



The plot of 15*211 vs. frequency forms a Lorentzian curve with the resonant frequency located 
at the position of the maximum magnitude (Fig. |I]). A numerical investigation of 15*211 with 
and without the simplified denominator assumption leading to Eq. (|^), shows that even 
for a relatively low Q [Q =100), the difference between the magnitudes is less than half a 
percent of the magnitude using Eq. (|I]). For larger Q the difference is much smaller, so 
we take this assumption as valid. All of the analysis methods treated in this paper make 
use of the simplified denominator assumption, as well as all the data we create to test the 
methods. 

The plot of the imaginary part of 52i (Eq. (^) versus the real part (with frequency as a 
parameter), forms a circle in canonical position with its center on the real axis (Fig. |^). The 
circle intersects the real axis at two points, at the origin and at the location of the resonant 
frequency. 

Important alterations to the data occur when we take into account several aspects of the 
real measurement situation. The first modification arises when considering the cross talk 
between the cables and/or the coupling structures. This introduces a complex translation 
X = (xo, Vo), of the center of the circle away from its place on the real axis.El'il'iil Secondly, 
a phase shift is introduced because the coupling ports of the resonator do not necessarily 
coincide with the plane of the measurement. This effect rotates the circle around the origin 
(Fig. The corrected complex transmission coefficient, 52i, is then given by: 

^2i = (^2i + X)e^<^ (5) 

It should be noted that the order in which the translation and rotation are performed is 
unique. ill 

Any method of determining Q and fo from complex transmission data must effectively 
deal with the corruption of the data represented by Eq. (|). In addition, the method used 
to determine fo and Q must give accurate and precise results even in the presence of noise. 
This is necessary since, in typical measurements, Q ranges over several orders of magnitude 
causing the signal-to-noise ratio (SNR, defined in section III. c.) during a single data run to 
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vary significantly. Further corruption of tlie data can occur if there are nearby resonances 
present, particularly those with lower Q. This introduces a background variation onto the 
circles shown in Fig. ^ and may interfere with the determination of fo and Q. In this paper 
we consider only single isolated resonances and refer the reader to an existing treatment of 
multiple resonances.il 



III. DATA USED FOR METHOD COMPARISON 

In this section we discuss the data we use for making quantitative comparisons of each 
method. The data is selected to be representative of that encountered in real measurement 
situations. Each trace consists of 801 frequency points, each of which have an associated 
real and imaginary part of 821- Two types of data have been used for comparing the 
methods; measured data and generated data. The measured data is collected with the 
network analyzer and cavity described below. The generated data is constructed to look like 
the measured data, but the underlying Q and resonant frequency are known exactly. All of 
the methods discussed in the next section are tested using exactly the same data. 



A. Measured Data 

Complex transmission coefficient vs. frequency data is collected using a superconducting 
cylindrical Niobium cavity submerged in liquid Helium at 4.2 K. Microwave coupling to the 
cavity is achieved using magnetic loops located at the end of 0.086" coaxial cables. The 
loops are introduced into the cavity with controllable position and orientation. The coaxial 
cables come out of the cryogenic dewar and are then connected to an HP8510C vector 
network analyzer.0 The cavity designil has recently been modified to allow top-loading of 
the samples into the cavity. 

A sample is introduced into the center of the cavity on the end of a 
sapphire rod. The temperature of the sample can be varied by heating the rod, with 
a minimal perturbation to the superconducting Nb walls. The quality factor of the cavity 
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resonator in the TEqh mode can range from about 2 x 10^ to 1 x 10^, with a resonant 
frequency of approximately 9.6 GHz. In a typical run with a superconducting crystal, where 
the temperature varies from 4.2 K to 200 K, fo decreases by about 10 MHz and Q changes 
from about 1 x 10^ to 4 x 10^. For accurate measurement of the electrodynamic properties 
of samples, it is important to be able to resolve frequency shifts of the cavity as small as 1 
Hz at low temperatures. 



1. Fixed Powers 

One hundred 5'2i vs. frequency traces were taken using the network analyzer held at a 
fixed power and with constant coupling to the cavity. One such data set was made with 
the source power at +15 dBm (SNR ^ 368, ^ 9.600242 GHz, Q ^ 6.39 x 10^), another 
set was taken with the source power at +10 dBm (SNR fa 108, fo ~ 9.599754 GHz, Q ^ 
6.46 X 10^), a third data set was taken with the source power at +3 dBm (SNR a; 49, ~ 
9.599754 GHz, Q 6.50 x 10^). (The approximate values for /„ and Q are obtained from 
the phase vs. frequency averages discussed below) 



2. Power Ramp 

To collect data with a systematic variation of signal-to-noise ratio, we took single traces 
at a series of different input powers. A power-ramped data set was taken in a cavity where 
controllable parameters, such as temperature and coupling, were fixed, the only thing that 
changed was the microwave power input to the cavity. An 5'2i vs. frequency trace was taken 
for powers ranging from —18 dBm to +15 dBm, in steps of 0.5 dBm. This corresponds to 
a change in the signal-to-noise ratio from about 5 to 168 {fo ~ 9.603938 GHz, Q a; 8.71 x 
10^). 
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B. Generated Data 



To check the accuracy of all the methods, we generated data with known characteristics, 
and added a controlled amount of noise to simulate the measured data. The data was created 
using the real and imaginary parts of an ideal S21 as a function of frequency Eq. (j^); 

Re S,, if) = M S,, if) = }f ^ (6) 

Where S21 is the diameter of the circle being generated (see Fig. H), Q is the quality factor, 
and fo is the resonant frequency, which are all fixed. The frequency /, is incremented around 
the resonant frequency to create the circle. There are 400 equally spaced frequency points 
before and after the resonant frequency, totaling 801 data points. The total span of the 
generated data is about four 3dB bandwidths for all Q values. 

To simulate measured data, noise was added to the data using Gaussian distributed 
random numbersB that were scaled to be a fixed fraction of the radius, r of the circle 
described by the data in the complex 5*21 plane. The noisy data was then translated and 
rotated to mimic the effect of cross talk in the cables and coupling structures, and delay 
(Eq. (§)). 

1. Power Ramp 

A power ramp was simulated by varying the amplitude of the noise added to the circles. 
A total of 78 S21 vs. frequency traces were created with a variation of the signal-to-noise 
ratio from about 1 to 2000 (/„ = 9.600 GHz, Q = 1.00 x 10^ Xo = 0.1972, yo = -0.0877, 
r = 0.2, = 7r/17) 

2. Fixed Q Values 

Data with different fixed Q values were created using the above real and imaginary 
expressions for S'21. Groups of data were created with 100 traces each using: Q = 10^, 10^, 
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10^, 10^ (/o = 9.600 GHz and SNR ^ 65 for all sets). They include fixed noise amplitude, 
and were each rotated and translated equal amounts to simulate measured data, {xo = 0.01, 
yo = 0.015, r = 0.2, (p = n/19) 



C. Signal-to-Noise Ratio 



The signal-to-noise ratio was found for all data sets by first determining the radius rdrde, 
and center (xc, Vc) of the circle when plotting the imaginary part of the complex transmission 
coefficient vs. the real part (Fig. Next, the distance to each data point (xj, yi) (i = 1 to 
801) from the center is calculated from: 



In the case of generated data, where the center and radius of the circle are known, the SNR is 
very well defined. However, the SNR values are approximate for the measured data because 
of uncertainties in the determination of the center and radius of the circles. 



In this section we summarize the basic principles of the leading methods for determining 
the Q and resonant frequency from complex transmission coefficient vs. frequency data. 
Further details on implementing these particular methods can be found in the cited refer- 
ences. Because we believe that this is the first published description of the inverse mapping 
technique, we shall discuss it in more detail than the other methods. The Resonance Curve 
Area and Snortland techniques are not widely known, hence a brief review of these methods 
is also included. 




(7) 



The signal-to-noise ratio is defined as: 



SNR 




(8) 



IV. DESCRIPTION OF METHODS 
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The first three methods take the data as it appears and determine the Q from the 
estimated bandwidth of the resonance. The last four methods make an attempt to first 
correct the data for rotation and translation (Eq. (|^)), then determine fo and Q of the data 
in canonical position. 



A. 3 dB Method 

The 3 dB method uses the 15211 vs. frequency data (Fig. |l]), where 15211 = 
\J (Re 5*21)^ + (ImS'21)^. The frequency at maximum magnitude is used as the resonant 
frequency, fo- The half power points (^-^ max 15211^ are determined on either side of the 
resonant frequency and the difference of those frequency positions is the bandwidth Af^dB- 
The quality factor is then given by: 

Q = fo/AfsdB (9) 

Because this method relies solely on the discrete data, not a fit, it tends to give poor results 
as the signal-to-noise ratio decreases. 



B. Lorentzian Fit 

For this method, the 1 5*211 vs. frequency data is fit to a Lorentzian curve (Eq. (||) and 
Fig. IID using a nonlinear least squares fit.il The resonant frequency fo, bandwidth Afiorenu 
constant background Ai, slope on the background ^2, skew ^3, and maximum magnitude 
|5max| are used as fitting parameters for the Lorentzian: 

1521 (/)| =A, + A,f + + ^ (10) 

Y V ^fhormt J 

The least squares fit is iterated until the change in chi squared is less than 1 part in 10^. 
The Q is then calculated using the values of fo and Afiorent from the final fit parameters: 
Q = fol Afiorent- This method is substantially more robust in the presence of noise than 
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the 3 dB method. For purposes of comparison with other methods, we shall use the simple 
expressions for and Q given above, rather than the values modified by the skew parameter. 



C. Resonance Curve Area Method 

In an attempt to use all of the data, but to minimize the effects of noise in the determi- 
nation of Q, the Resonance Curve Area (RCA) method was developed.il In this approach 
the area under the 15*21 (/)|^ curve is integrated to arrive at a determination of Q. In detail, 
the RCA method uses the magnitude data squared, 15211^, versus frequency and fits it to a 
Lorentzian peak (same form as Fig. [^): 

\S2i{ff = py-—^ (11) 



using the resonant frequency, /„, and the maximum magnitude squared, Po , as fitting 
parameters. The bandwidth Af^cA is a parameter in the Lorentzian fit, but is not allowed 
to vary. This method iterates the Lorentzian fit until chi squared changes by less than 1 part 
in 10^. Next, using the fit values from the Lorentzian, the squared magnitude IS'21 (/o ± /r)|^ 
is found at two points fo ± fr on the tails of the Lorentzian far from the resonant frequency. 
The area under the data, 5*1, from fo — fr to fo + fr (symmetric positions on either side of 
the resonant frequency) is found using the trapezoidal rule:@ 

Sl= f"^^^ \S21,dataU)?df = ^(l'52Maia(A^)|'+|^2Mata(A^ + l)|') (12) 

Here 1521,^0*0 (^)l^ indicates the magnitude squared data point at the frequency A^, and 6f 
is the frequency step between consecutive data points. 

The quality factor is subsequently computed from the follows:! 



p 

Q = /o-Frtan"^ 



^" - 1 (13) 



Si \\S2l{fo±fr 

This Q is compared to the previously determined one. If Q changes by more than 1 part 
in 10^, the Lorentzian fit is repeated using as initial guesses for fo and Po, the values of 
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fo and Po from the previous Lorentzian fit, but the fixed value of the bandwidth becomes 
^Irca = fo/Q- With the new returned parameters from the fit, Q is again computed 
by Eqs. (|12|) and (|T3|) and compared to the previous one, and the cycle continues until 
convergence on Q is achieved. This method is claimed to be more robust against noise 
because it uses all of the data in the integral given in Eq. (|T2|).ii 

All of the above methods assume a simple Lorentzian-like appearance of the |S'2i| vs. 
frequency data. However, the translation and rotation of the data described by Eq. can 
significantly alter the appearance of |S'2i| vs. frequency. In addition, other nearby resonant 
modes can dramatically alter the appearance of 15*2110 For these reasons, it is necessary, 
in general, to correct the measured S21 data to remove the effects of cross-talk, delay, and 
nearby resonant modes. The remaining methods in the section all address these issues before 
attempting to calculate the Q and resonant frequency. 



D. Inverse Mapping Technique 

1. Circle Fit 

The inverse mapping technique, as well as all subsequent methods in this section, make 
use of the complex S21 data and fit a circle to the plot of Im(S'2i) vs. Re(S'2i) (Fig. ||). 
The details of fits of complex S21 data to a circle have been discussed before by several 
authors.0'Ei The data is fit to a circle using a linearized least-squares algorithm. In the 
circle fit, the data is weighted by first locating the point midway between the first and last 
data point; this is the reference point {xref.Vref) (see Fig. 0). Next, the distance from the 
reference point to each data point {xi,yi) is calculated. A weight is then assigned to each 
data point (i = 1 to 801) as: 

(14) 

This gives the points closer to the resonant frequency a heavier weight than those further 
away. The circle fit determines the center and radius of a circle which is a best fit to the 
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Xi 



+ iVref - Vi 



data. 



2. Inverse Mapping 

We now know the center and radius of the circle which has suffered translation and 
rotation, as described by Eq. (^. Rather than un-rotating and translating the circle back 
into canonical position, this method uses the angular progression of the measured points 
around the circle (as seen from the center) as a function of frequency to extract the Q 
and resonant frequency.il Three data points are selected from the circle, one randomly 
chosen near the resonant frequency (/2), and two others (/i and /a) randomly selected but 
approximately 1 bandwidth above and below the resonant frequency (see Fig. (b)). Figure 
^ (a) shows the complex frequency plane with the measurement frequency axis (Im/) and 
the pole of interest at a position ifo - AfMapf^- The conformal mapping defined by: 

maps the imaginary frequency axis into a circle in canonical position in the 5*21 plane (this 
mapping is obtained from Eq. (^ by rotating the frequency plane by e~*'^/^). Under this 
transformation, a line passing through the pole in the complex frequency plane (such as the 
line connecting the pole and 2/2 in Fig. ^ (a)) will map into a line of equal but opposite slope 
through the origin in the 5*21 plane.ii In addition, because the magnitudes of the slopes are 
preserved, the angles between points /i and /2 (6'i), and points /2 and /a (6^2), in the S21 
plane (Fig. |] (b)) are exactly the same as those subtended from the pole in the complex 
frequency plane (Fig. ^ (a)).0 The angles subtended by these three points, as seen from 
the center of the circle in the S21 plane, define circles in the complex frequency plane which 
represent the possible locations of the resonance pole (dashed circles in Fig. | (a)).0'ill 
The intersection of these two circles off of the imaginary frequency axis uniquely locates the 
resonance pole. The resonant frequency and Q are directly calculated from the pole position 
in the complex frequency plane as fo and fo/ ^fhiap- This procedure is repeated many times 
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by again choosing three data points as described above, and the results for Q and resonant 
frequency are averaged. 



E. Modified Inverse Mapping Technique 

We find that the fit of the complex 5*21 data to a circle is critically important for the 
quality of all subsequent determinations of Q and fo- Hence we experimented with different 
ways of weighting the data to accomplish the circle fit. The modified inverse mapping 
technique is identical to the previous inverse mapping, except for a difference in the weighting 
schemes for the fit of the data to a circle (Fig. 0). Here the weighting on each data point, 
known as the standard weighting, is: 



W. 



StndA 



{Xref - Xif + {Vref - Vif (16) 



and is the square root of the weighting in Eq. (|T^). Other kinds of weighting will be 
discussed in section VI. 



F. Phase versus Frequency Fit 

In the phase vs. frequency fit, El the complex transmission data is first fit to a circle as 
discussed above for the inverse mapping technique. In addition, an estimate is made of the 
rotation angle of the circle. The circle is then rotated and translated so that its center lies 
at the origin of the S21 plane (rather than canonical position), and an estimation of the 
resonant frequency is found from the intersection of the circle with the positive real axis (see 
Fig. ^ inset). The phase angle of every data point with respect to the positive real axis is 
then calculated. Next the phase as a function of frequency (Fig. ^), obtained from the ratio 
of the two parts of Eq. (^), is fit to this form using a nonlinear least-squares fitS 

</>(/) = </>o + 2tan- 




(17) 
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In this equation 0o, the angle at which the resonant frequency occurs, /o, and Q are de- 
termined from the fit.ll A weighting is used in the fit to emphasize data near the resonant 
frequency and discount the noisier data far from the resonance which shows httle phase 
variation. Again we find that the quahty of this fit is sensitive to the method of fitting the 
original 5'2i data to a circle. 



G. Snortland Method 

As will be shown below, the main weakness of the Inverse Mapping and Phase versus 
Frequency methods is in the initial circle fit of the complex 5*21 data. To analyze the 
frequency dependence of the data, or to bring the circle back into canonical position for 
further analysis, the center and rotation angle (Eq. ^) must be known to very high precision. 
The Snortland method makes use of internal self-consistency checks on the data to make 
fine adjustments to the center and rotation angle parameters, thus improving the accuracy 
of any subsequent determination of the resonant frequency and Q. 

The Snortland method^ starts with a standard circle fit and phase vs. frequency fit 
(Fig. H) as discussed above. A self-consistency check is made on the S21 data vs. frequency 
by making use of the variation of the stored energy in the resonator as the frequency is 
scanned through resonance. As the resonant frequency is approached from below, the current 
densities in the resonator increase. Beyond the resonant frequency they decrease again. 
Hence a sweep through the resonance is equivalent to an increase and decrease of stored 
energy in the cavity and power dissipated in the sample. In general, there is a slight nonlinear 
dependence of the sample resistance and inductance on resonator current /. This leads to 
a resonant frequency and quality factor which are current-level dependent. The generalized 
expression for a resonator with current-dependent resonant frequency and Q iJ^ll 

where cUmax and Qmax are the resonant frequency and Q at the point of maximum current 
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in the resonator, /max- The Q and resonant frequency are therefore determined at every 
frequency point on the resonance curve a si 

g(/) ^ (19) 

= [l + Im[A/2Qmax] 

If it is assumed that the response of the resonator is non-hysteretic as a function of power, 
then the up and down "power ramps" must give consistent values for the Q and resonant 
frequency at each current level. If the data is corrupted by a rotation in the S21 plane, 
the slight nonlinear response of Q and /<, with respect to field strength causes the plots of 
Q and fo vs. the current level to trace out hysteresis curves.iil By adjusting the rotation 
phase angle and Qmax parameters, one can make the two legs of the Q{I) and uJo{I) curves 
coincide, thereby determining the resonant frequency and Q more precisely.0 

In practice, the resonant frequency is determined from a fit to the non-linear inductance 
as a function of resonator current / through uj{I)~'^ = Cq+CiI so that uj-^ax = VVco + Ci/max- 
Qmax is determined by making the two legs of the lJo{I) curve overlap. The resulting deter- 
mination of resonant frequency and quahty factor are cUmax and Qmax, respectively. 



V. COMPARING METHODS AND DISCUSSION 

The values of Q and fo obtained by each method for a group of data (e.g. fixed power or 
fixed Q) are averaged and their standard deviations are determined. These results are used 
to compare the methods. The accuracy of each method is determined using the generated 
data since, in those cases, the true values for Q and fo are known. The most accurate 
method is simply the one that yields an average {fo, Q)closest to the actual value {f^"-"^^^ 
Qknowny rjj-^g standard deviations (a^^, ag) for the measured data are used as a measure of 
precision for the methods. The smaller the standard deviation returned, the more precise 
the method. To determine the most robust method over a wide dynamic range of Q and 
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noise, both accuracy and precision are considered. Hence the algorithm that is both accurate 
and precise over varying Q or noise is deemed the most robust. 

A. Fixed Power Data 

Figures ^ and ^ show the values of fo and Q respectively, resulting from the Lorentzian 
fit (B), the modified inverse mapping technique (E), and the phase vs. frequency fit (F), for 
the +10 dBm (SNR 108) fixed power run. For /„, all three methods return values that are 
very close to each other. This is verified by the ratios of (Tf^/ fo for those methods shown in 
Table |I[ which shows the normalized ratio (normalized to the lowest number) of the standard 
deviation of fo and Q to their average (cr/„//o, ctq/Q) returned by each method on identical 
data. The difference in fo from trace to trace, seen in Fig. |] is due entirely to the particular 
noise distribution on that 5*21 (/) trace. On the other hand, the determinations of Q are 
very different for the three methods. From Fig. ^, we see that the phase vs. frequency fit 
is more precise in finding Q than both the Lorentzian fit and the modified inverse mapping 
technique (see also Table 1). Thus the fixed power data identifies the phase vs. frequency 
fit as the best. 

B. Power-Ramped Data 

Figures |^ and |^ show the results for fo and Q respectively, from the same methods, for 
the measured power-ramped data sets. The data are plotted vs. the signal-to-noise ratio 
(SNR) discussed in section III. As the SNR decreases, the determination of fo becomes less 
precise, but as in the case of fixed power, all of the methods return similar ratios for <Jf„/ fo 
as confirmed by Table |. The determination of Q also becomes less precise as the SNR 
decreases tending to overestimate its value for noisier data. But, from Fig. ||, we see that 
while the modified inverse mapping technique and phase vs. frequency fit give systematically 
increasing values of Q as the SNR decreases, the Lorentzian fit simply jumps around the 
average value. This implies that for a low SNR, the Lorentzian fit is a more precise method. 
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Table | confirms this statement by showing that the Lorentzian fit has the smallest ratio 
of oqIQ. We thus conclude that over a wide dynamic range of SNR the Lorentzian fit is 
superior, although the phase vs. frequency fit is not significantly worse. 

From figures |^ and ||, we see that the fo determination does not degrade nearly as much 
as the Q determination as SNR decreases. Here, (Tj^/ fo changes by a factor of 2, while 
OqIQ changes by a factor of 300 as SNR decreases from 100 to 3, so the precision in the 
determination jo is much greater than that of Q. The trend of decreasing Q as the SNR 
increases beyond a value of about 50 in Fig. || is most likely due to the non-linear resistance 
of the superconducting walls in the cavity. An analysis of generated data power-ramps does 
not show a decreasing Q at high SNR. 



C. Precision, Accuracy, and Robustness 

The most precise methods over different fixed powers are the nonlinear least squares fit 
to the phase vs. frequency (F) and the Lorentzian nonlinear least squares fit (B) (Table |). 
They consistently give the smallest ratios of their standard deviation to their average for 
both Q and jo compared to all other methods. At high power (SNR > 350) the phase vs. 
frequency fit is precise to about 3 parts in 10^° for the resonant frequency and to 3 parts in 
10"^ for the quality factor, when averaged over about 75 traces. 

When looking at the generated data with SNR ^ 65, the most accurate method for the 
determination of the resonant frequency is the phase vs. frequency fit, because it returns 
an average closest to the true value, or as in Table it has the smallest ratio of the 

I y jknown I 

difference between the average and the known value divided by the known value ( ° r known — , 

Jo 

jknown I 

Qknown )■ The value returned for the resonant frequency is accurate to about 8 parts in 
10® for Q = 10^, and 1 part in 10^ for Q = 10^ when averaged over 100 traces. For the 
quality factor, the phase vs. frequency fit (F) is most accurate (Table |ID , with accuracy to 
about 1 part in 10^ for Q = 10^, and 1 part in lO'* for Q = 10^ when averaged over 100 
traces. 
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The method most robust in noise is the Lorentzian fit (see the power ramp columns of 
both Tables). It provided values for and Q that were the most precise and accurate as 
the signal-to-noise ratio decreased (particularly for SNR < 10). Over several decades of Q, 
the most robust method for the determination of fo is the phase vs. frequency fit, which 
is precise to about 1 part in 10^ when Q = 10^, and to about 1 part in 10*^ when Q = 
10^, averaged over 100 traces with SNR ^ 65. For the determination of Q, the phase vs. 
frequency (F) is also the most robust, providing precision to 2 parts in 10^ when Q = 10^ 
to 10^ averaged over 100 traces. 

VI. IMPROVEMENTS 

The first three methods discussed above (3dB, Lorentzian fit, and RCA method) can be 
improved by correcting the data for rotation and translation in the complex 5*21 plane. All of 
the remaining methods can be improved by carefully examining the validity of the circle fit. 
We have observed that by modifying the weighting we can improve the fit to the circle for 
noisy data, and thereby improve the determination of Q and /<,. For instance. Fig. ^ shows 
that the standard weighting (the weighting from the modified inverse mapping technique) 
systematically overestimates the radius of the circle for noisy data. Below we discuss several 
ways to improve these fits. 

By introducing a radial weighting, we can improve the circle fit substantially (an example 
is shown in Fig. ^). For the radial weighting, we first do the standard weighting to extract 
an estimate for the center of the circle {xcVc), which is not strongly corrupted by noise. 
The radial weighting on each point (i = 1 to 801) is then defined as: 

WRadial,i = I ^ ^ (21) 

\J (xc - Xi) + {yc - y^) 

which reduces the influence of noisy data points well outside the circle. Figure ^ shows a 
plot of the calculated radius versus the signal-to-noise ratio for the generated power-ramped 
data set. The figure shows plots of the calculated radius using four different weightings: 
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Wstnd (Eq. (|T6D), WRadiai (Eq. (|T|)), Wjiili^i, and W^^aiai- From this plot, it is clear that 
above a SNR of about 30 all of the weightings give very similar radius values. However, 

1/2 

below that value we see that the radius from the W^^^^^i weighting agrees best with the 
true radius of 0.2. Therefore, by improving the circle fit with a similar weighting scheme, 
we hope to extract even higher precision and better accuracy from these methods at lower 
signal-to-noise ratio. 

In addition to errors in the fit radius of the circle at low SNR, there can also be errors 



in the fit center of the circle. Figure |lT| shows the normalized error, Ec- 

E, 



1/2 

in the calculation of the center of the circle from weightings: Wstnd, WRadiai, ^Radiah 
^Radial, SNR in log scaling. Here (xc, i/c) is the true center of the circle and {xfu, yju) 



is the calculated center from the circle fit. From Fig. 0, we see that the calculation of the 
center of the circle is accurate to within 1% for SNR ^ 20 and above using any weighting. 
However, below SNR = 10, all of the weightings give degraded fits. The inset (b) of Fig. 



TT| shows the angle a vs. SNR, where a is the angle between the vector connecting the 
true and calculated centers, and the vector connecting the true center to the position of the 
resonant frequency. From this figure we see that the angle between these vectors approaches 
vr as SNR decreases, which means that the fit center migrates in the direction away from 
the resonant frequency as the data becomes noisy. This indicates that the points on the 
side of the circle opposite from the resonant frequency have a combined weight larger than 
those points around the resonant frequency, and thus the center is calculated closer to those 
points. 

For data with SNR greater that about 10, all weightings give similar results for the circle 
fits. For data with SNR less than 10, the best circle fit would make an estimate of the radius 
of the circle by using the square root radial weighting, and an estimate of the center by 
weighting data near the resonant frequency more heavily. 

A further refinement of the inverse mapping method would be to fit the data with an 
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arbitrary number of poles and zeroes to take account of multiple resonances in the frequency 
spectrum.!! 

The Snortland method was originally developed to analyze non-linear resonances.0 Our 
use of it for linear low-power resonances was preliminary, and the results probably do not 
reflect its ultimate performance. Further development of this method on linear resonances 
has the potential to produce results superior to those obtained with the phase vs. frequency 
method at high SNR. 

VII. CONCLUSIONS 

We find that the phase versus frequency fit and the Lorentzian nonlinear least squares 
fit are the most reliable procedures for estimating and Q from complex transmission 
data. The Lorentzian fit of 15*211 vs. frequency is surprisingly precise, but suffers from 
poor accuracy relative to vector methods, except for very noisy data. However, a major 
advantage of vector data is that it allows one to perform corrections to remove cross talk, 
delay, and nearby resonances, thus significantly improving the quality of subsequent fits. 
For the fixed-power measured data sets, the phase vs. frequency fit has the highest precision 
and accuracy in the determination of fo and Q making it the best method overall. All of 
these methods are good for SNR greater than about 10. Below this value, all methods of 
determining Q and resonant frequency from complex transmission coefficient data degrade 
dramatically. Concerning robustness, the phase vs. frequency fit does well for a dynamic 
range of Q, while the Lorentzian fit does well in the power-ramp (SNR = 1 to 2000). 

We also find that significant improvements can be made to the determination of reso- 
nant frequency and Q in noisy situations when careful attention is paid to the circle fitting 
procedure of the complex S21 data. Further development of the inverse mapping and Snort- 
land methods can greatly improve the accuracy and precision of resonant frequency and Q 
determination in realistic measurement situations. 
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TABLES 

TABLE I. Measurements of relative precision of the seven methods used to determine fo and 

Q from complex transmission data. Tabulated arc ratios of the standard deviation to the average 
values for both resonant frequency [u^fo)/ fo) and quality factor {a-{Q)/Q) normalized to the best 
value (given in parentheses), for SNR 49, 368, and ramped from 5 to 168. All entries are based 
on measured data. 

Precision Table Noisy (P = +3 dBm, SNR « 49) Less Noisy (P = +15 dBm, SNR « 368) Power Ramp (SNR « 5 to 168 ) 

Method Q fo Q fo Q fo 

3 dB 5.91 1.069 7.50 4.77 190.44 1.274 

Lorentzian 1.55 1.025 2.27 1.10 1 (1.91 x 10"^) 1.004 

RCA 5.66 1.030 5.24 1 11.04 1.031 

Inverse Mapping 6.02 1.021 7.95 1.57 4.27 1.321 

Modified Mapping 1.49 1.031 5.89 2.13 1.61 1 (7.17 x IQ-^) 

Pliase vs. Preq 1 (2.51 x 10"^) 1 (1.15 x lO"*^) 1 (2.80 x lO"*) 1 (3.12 x IQ-^O) 1.47 1.025 

Snortland 2.27 1.029 2.09 1 5.98 1.086 
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TABLE II. Measurements of the relative accuracy of the seven methods used to determine fo 
and Q from complex transmission data. Tabulated are ratios of the difference of the averages of fo 

and Q from the known value divided by the known values, for both resonant frequency ( f known — ) 

J o 

^known I 

and quality factor ( Qknown — )■ The entries are normalized to the best value (given in parentheses), 
for Q = 10^, Q = 10^ (both with SNR 65), and SNR ramped from 1 to 2000. Ah entries are 

based on generated data. 



Accuracy Table 


Q = 10^ 




Q = 105 




Power Ramp (SNR « 1 to 2000 ) 


Method 


Q 


fo 


Q 


fo 


Q 


fo 


3 dB 


253.08 


217.39 


240.21 


117.15 


401.48 


43.87 


Lorentzian 


15.38 


27.25 


14.93 


17.28 


1 (3.11 X 10-2) 


1 (1.46 X 10-9) 


RCA 


246.15 


403.05 


23.35 


217.76 


8.39 


73.39 


Inverse Mapping 


3.85 


3.01 


10.43 


2.21 


2.84 


5.72 


Modified Mapping 


2.77 


3.5 


5.64 


1.57 


1.83 


8.43 


Piiasc vs. Frcq 


1 (1.30 X 10""') 


1 (7.88 X IQ- 


-«) 1 (1.40 X 10-4) 


1 (1.46 X 10"'') 


4.03 


12.00 


Snortland 


103.08 


12.68 


95.21 


8.50 


5.11 


13.50 
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FIGURES 

FIG. 1. Measured magnitude of the complex transmission coefficient S21 of a superconducting 
resonator as a function of frequency for measured data (Input power = +10 dBm, SNR ~ 108). 
A Lorentzian curve is fit to the data as described in the text. Inset is the lumped element model 
circuit diagram for the resonator. The input and output transmission lines have impedance Zo, 
Irni and lm2 arc coupling mutual inductances, C is the capacitance, R is the resistance, and L is 
the inductance of the model resonator. 

FIG. 2. Measured imaginary vs. real part of the complex transmission coefficient S21 for a 
single resonant mode (Input power = +3 dBm, SNR k. 49). This plot shows data and a circle fit, 
as well as the translated and rotated circle in canonical position. {X Ri (1.67 x 10~^, —2.52 x 
10^^), (f) ~ 116°). Large dots indicate centers of circles, and the size of the translation vector has 
been exaggerated for clarity. 

FIG. 3. (a). The complex frequency plane is shown with frequency points /i, /2, and /a on 
the imaginary axis and a pole off of the axis. The imaginary frequency axis is mapped onto the 

complex S21 plane (b) as a circle in canonical position, and the corresponding frequency points are 
indicated on the circumference of the circle. 

FIG. 4. Measured phase as a function of frequency for measured data (SNR k, 31), both data 
and fit are shown. Inset is the translated and rotated circle, where its center is at the origin and 
the phase to each point is calculated from the positive real axis. 

FIG. 5. Plot of fit resonant frequency versus trace number for measured data when the source 
power is +10 dBm. Results are shown for three methods discussed in the text. 

FIG. 6. Plot of fit quality factor versus trace number for measured data when the power is +10 
dBm. Results are shown for three methods discussed in the text. 

FIG. 7. Plot of fit resonant frequency versus the signal-to-noise ratio on a log scale for the 
measured power-ramped data set. Results are shown for three methods discussed in the text. 
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FIG. 8. Plot of fit quality factor versus the signal-to-noise ratio on a log scale for the measured 
power-ramped data set. Results are shown for three methods discussed in the text. 

FIG. 9. Measured imaginary vs. real part of the complex transmission coefficient for measured 
data (SNR ^ 4, X ^ (7.22 x lO'^, 3.26 x 10"^), ^ 220"). Plot shows data and two circle 
fits, one where the standard weighting is used (dashed line), and one where the square root radial 
weighting is used (solid line). 

FIG. 10. The calculated circle fit radius vs. the signal-to-noise ratio on a log scale is shown for 
the generated power-ramped data set. The plot shows the results from four different weightings: 
Wstnd, WRadial, W^adial^ ^R^diaV ^he true value for the radius is 0.2. 

FIG. 11. The normalized error in the determination of the center of the fit circle is shown vs. 
the signal-to-noise ratio on a log scale for the generated power-ramp data. Results are from the 
weightings: Wstnd, WRadial, W^ladia^ ^Radial- I^^et (a) is a plot of the true circle (solid line) and 
the fit circle to the data (dashed line) to show that the determination of the center from the fit 
{xfit, Vfit) is located at an angle a from the line connecting the true center [xc, Uc) to the resonant 
frequency point, fo- The distance from the true center to the calculated center is related to the 
normalized error in the calculated center Ec- Inset (b) is a plot of the angle a vs. log of SNR for 
the generated data. 



29 



0.007 




0.001 ' — ' — ' — ^ — ' — ' — ' — ' — ^ — ' — ' — ' — ' — ^ — ' — ' — ' — ' — ^ — ' — ' — ' — ' — ^ — ' — — 
9,599,752,000 9,599,754,000 9,599,756,000 

Frequency (Hz) 



Petersan 
Figure 1 




0.004 



_l I L. 



-I I L. 



_l I L. 



-I I L. 



_l I L. 



-I I L. 



_l I L. 



-0.004 



0.004 



0.008 



Re {S^^} 



Petersan 
Figure 2 




9,603,936,500 9,603,938,000 9,603,939,500 



Frequency (Hz) 



Petersan 
Figure 4 



N 

a 

^ 9,599,754,250 

a 

u 



o 



9,599,754,100 



9,599,753,950 



Petersan 
Figure 5 




Trace Number 



6,520,000 



o 

^ 6,460,000 

13 
O 



6,400,000 




Lorentzian Fit 



Modified Inverse Mapping 
Phase vs. Frequency 



2 



4 



6 



8 



100 



Trace Number 



Petersan 
Figure 6 



a 

w 9,603,938,500 

D 

U 

^ 9,603,938,300 

© 



9,603,938,100 



1 1 1 r 



T 1 1 r 




Lorentzian Fit 

Modified Inverse Mapping 

Phase vs. Frequency 



1 



100 



Signal-to-Noise Ratio 



Petersan 
Figure 7 




10 100 



Signal-to-Noise Ratio 



Petersan 
Figure 8 



0.004 




Standard Weight 



-0.008 -0.004 0.004 

Re [S^,] 

Petersan 
Figure 9 



0.25 



0.2 




A' 



f 



X 0.15 



0.1 



n\ 
f 



■ ■ 

■ ■ 



1 



— -Standard 

Radial Weight W 

W Square 

— Square Root W 



100 



Signal to Noise Ratio 



Petersan 
Figure 10 




Petersan 
Figure 11 



Signal-to-Noise Ratio 



